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By\observing the attentiveness of children watching 
ims of "The Electric Company." the staff of the 


six pilot programs of "The Electric Coapany," the staff of the 
Children’s Television Workshop (CTf) gathered detailed data on the 
visual appeal of the show. Six high appeal attributes were isolated: 

(1) functionally relevant action; (2) strong rhytha and rhyae; (3) 
electronic bridges; (4) involving children; (5) on-stage correcting 
of verbal performance!; and (6) "do it one better" these. Three other . • 
studies were aIso-coupleted: one which demonstrated that the level of 
attention given to ohe bit is dependent on the attention given to the 
preceding bit; one which developed a model to predict the appeal'of^s^. 
new material; and one which attempted to refine the definitions of 
program attributes. hEHH) l . - 
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A series of studies were\done for the Qhildrei?' s\Television Workshop 


to discover the attributes of program material that mos^*effect target 


audiencp attention levels and'to develop guidelines.for predicting the 

. , •' ’ : } 

appeal of new material. 

* - 1>he CTW research staff had gathered detailed dtata on ttae visual 

! : 

appeal-of.the five pilot shows for "The Electric Company." The sample 
consisted of thirteen second- and third-graders in a day care center- 

♦ v 

' at a low-income housing development in New York. Children were observed 
individually as they watched the shows on a television monitor, and 
record was taken of whether or not they had looked at the screen every 
1\ seconds. Competing with the program material for the child's attention 


a back-screen slide prosector presented new pictures, one aftei/the 




other, every 1\ seconds. This "distractor technique" is the standard 

» 

procedure used by CTW to measure .visual appeal. 

Before the attribute analysis was begun, the raw^data collected by 

CTW had to be transformed; Overall percentage attention figures for each 

*1 ! 

ejpisode ("bit") were calculated, and these were converted to standard ( Z ) 
sjcores that reflected how 1jar above or bep.ow average was the attention to 
tjhat.bit, relative‘to the Overall attej 


alt occurred. 
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Study 1:- Intrinsic Attributes. 


Following the research procedure first presented in the dissertation, 


"Attributes that differentiate boys' from girls 1 


srencesj. for materials 


in the preschool classfoan: a systems'design approach/\by Langbourne W. 
Rust, Ed.D., Teachers jCollege, Columbia University,* 1971, the attention 

' f * 

scores- on each bit weie used to discover the attributes that were most 
strongly associated with high and low appeal. 

Nine-attributes! intrinsic to.the bj.ts in which they were found, were 


discovered. Of the/149 bits in the five pilot shows, 133 of them’{89%) 
were denoted by at Least one attribute.definition. 119 bits (80% qf the 
total) had high-appeal or low-appeal‘attributes exclusively, and to these 
bits, children's sjcores were accounted for'successfully at a rate of 4.0 

- ■ — j ■ - 

to 1. ' II , ' ‘ 

I* . . 

• ,* ‘ The isix higb-appcal attributes were named: functionally relevant 

* , ■’ . 4 • * 

action, strong rhythm and rhyme, electronic bridges, involving children, 

* 

on-stage correcting of verbal performance, and a "do it one better" theme. 

I; 

The full operational specifications of these attributes, of coi\rsej were 

* J ” , t v 

more dlaborate and precise. The three low-appeal attributes were: 

# 

comprehensible spoken script, n^ssage monologues, and starting/ending 


bits. 


The findings were instituted as guidelines for all future production 


at CTO. 


In addition to the positive discoveries,/ a number of attribute. . 


definitions (that did' not work out are of seme interest. The duration 


of bits' /was pot fopnd to bear aoy systemati/c relation to attention 


tribute . 


levels:/ very/long, bits wefe r\Jt necessarily Unappealing. The/presence 


of a mhsica^ sc4fe was unrelated to attention, |as wap the presence of lively 
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music. Animation 



, per se was neiffter attractive not unattraqtlv 
animated Id its had the attribute cJtN^unctional action, anH these were 
appealing; but the animated bij:s that did not* have this quality were not 

’ i* - * ^ ' % ' 

attended to, and bits that were not animated yet had this attribute £iad 
cqnsistently higli^scores J The identity of the particular characters in a 

bit did not.affect children's responses either; it was what they did and 

/ / „ ' ' * * . . . % 

how they cfid it that was important; • 

» . '{ ' 

' Study 2-. Contextual xAttributes and an Integrated Predictive Model 


\ 


The data on which the original analysis'was .based were more fully 


j . 


explored in this phase* in an attempt to improve predictive accuracy still 

further. The effect of a bit's context was investigate^ and a comprehensive. 

system was* developed to integrate both intrinsic and contextual factors 

* , + * 

to predict appeal. ; . 

• » 

I ■ » 

It was demonstrated that the level of attention given to on# bit is 

I ■ .• T 

related to the level of attention that, had been given to the bit/that . . 

T k • f . • * I 

both higher- or lower-thian-a^erage, 
[.as did bits with dissimifaf scores.^ 
exclusively high- or low-appeal 
Estimated context-2.1 times as often 


I -s 


scores! 


preceded it. Bits with similarj 
- followed each, other 2.6 times as often 
The scores of bits following tlose with 


attributes <wl 


as they were 


bre consistent wit! 


/ 


•ji the** 


inconsistent. There was;hq evidence that the influence Of 


visual attention to one bit' extends ^be^cjhd the bit'immediately following 
it/. It was 

oWrall scores of /bits tha.4/lasted/ less 
l^igth, the intrinsic attributes alone 


A general mbdel for/ predicting the 


xt effects only influenced the 

' , ,, 

than one minute; beyond that 

•counted best for/,the scores. 


appeal of untested material 


was developed. •One"' begins by determining the intrinsic attributes 

' ’ 

possessed by each bit in a show; then context effects are estimated; and 

I • • 

finally, the two are integrated to yield a prediction for each bit. 
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Following the modet that was ^developed, children's responses .to 34 bits 

- ' * * \ * ^ ’ 

f A * i 

were accounted ■ for successfully ,Y and to 18‘, unsuccessfully; ratio 


of 5.2 to 1. • i 


Study 3: , Validation;of the Original Model, Prediction to tigw Material 


-The model developed in Study 2 was used to predict-the responses-of» 
a new group of children (N‘ ,= 6) to the material in- shows 6—10 of "The 

■ •* v ! 

Electric Company." The^data for this validity check were collected under, 

v . »; I 

distractor conditions identical to those-employed for the first study. 
Predictions wer<? made fdr 88 of a total qf. 122 bits, and th| predictions 

i I ■ f ' ‘ / ;• ' . 

were accurate/in 62 cases; p success ratio of,2.4£o 1. Ch^-rsquare, with 2 
degrees of -free^Lm, is 20.2-and is Significant at a’,level $ell beyond 


/ T 


p = .001. Considering the very small size of the sample (pix children) 

F • T i » ' ' * ' , - • - i * 

and the consequent high, error component in the .attention sc okA the > 

•• ! ■ r i . \ . i ■ \ . 

results •J'/er^ vefy^encouraging. J ' ft 

: ' \* ' /• " > . . •! * 

I I 1 

Comparison of Attribute-Eas‘ed Predictions with Predictions Based on Pre-Testing 


Twenty-three bits hag occured in both the pilot shows and m shows 6- — 

.* ■* .! „ I ) 

10. It wa p thus, possiblejto predict the response of the new sample on the 
basis of fhe scorers' obtained previot^sly to the same bits. Predicting 


higher-than-average and l^wer-than-avetage on this basis, a succes.6 • 

' ' 1 : •- .- I ' 1 ( ■ “ ‘ ‘ - / •' 

ratio of 1.9-to 1 was achieved. Thjs compares^with the ratio of 2.4 to 1 ( 
attained by g^ie attribute-based moduli In addition to its advantages in 
being able to predict, responses to, untested material, the attribute model 


selpms to predict as well or betterv/than pretesting does-. 


Modification Of the Original Model 


The data on children's responses to the new material i; 


• i. _ __ /■ i ^ 
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offered sane clues for refining the original attribute definitions jand 

* - \ * * ‘ " \ 

.the predictive model. , , . ' , j . 

It was*.found that one attribute, Electronics. Bridges, could be 

* * ' ’ 

• « ' ’ / 

eliminated with'np net I 09 S in predictive power, and that the attribute, 

f 

Starting/Ending Bits, was best redefined to denote only show i|Bentifi— * 
cation material. It was also found advantageous to treat the first bit 

« * » ~ * i 

i • 4 . -V. 

„in each show as having a low-attention context, rather than treating 

• * . f 

it asy if it had no context at* alj. ^ - 

These three| refinements resulted in a substantial net improvement 
in accountmig fir both sets/of data. The'original/model had accounted 
for 73% of the .booled data wi^th an accuracy of 1 3.^5 to 1 (x^ = 60j.l ). 

1 1 :! I I' 

The refihed model accounted jor 65% of the Same data at 4.50' to { ■ 

(x 2 ,= 71.4). it accounted ejren batter than the original model for the pilot 

^data: 5.6 to ll versus 5.2 ty 1. Considering that the/gairi iri accuracy 

I _ t . 

was achieved through a simplification of* the original Model, viith eight 

! i . * / ■ 

instead of nine attributes, the improvement was a ma^or one.. 


/ 


Study 4: Use by pther Waters 


Raters were shown j Videotapes of the shows being investigated and were 
asked to classify-the/bits in/them wit^ respect to each of the defined N 


attributes. They had been fainiliar 


1 


iarizeR w'jtl 


ifth -the attributes only through . 


reading their operational definitions J Each.definition was evaluated 
‘ ' 

with respect to the consensus between raters as/to which bits possessed 

N a . / 

the attribute in question and which bits did not. 

The definitions were evaluated and modified twice to improve their 

1 

reliability. In the final evaluation three groups of four raters viewed 

and rated the material of three shows (each rater viewed one show). 

\ . ' 

Average percent agreement .between pairs of raters rgnged from 76% to 99% 
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and averaged 87%,. 


^ The discriminative power-o f the m odified attribute definitions when 

.used by other raters was also checked. One of the attributes was found 

! . p 

to contribute nothing toothers' ability to differentiate bits with high 


appeal- 


wit h low appeal, so it was eliminated.i With the 

• . ' si I 


remaining seven attributes, the classifications by. nine Jrateite of three j 
shows (three raters per show) resulted in 117 accurate predictions^ 39 j 

inaccurate ones, "arid 116 indeterminate, j Chi-bquare indilcLted a level j 

j ( i j . j I 

•of discrimination significantly better than chance. With 2 d.fi x 2 *=. 31.5, 


to which the indeterminate pjiredjlction. hjits contributed oply 0.5. p ( .001. 

j • i . | | j i I i ‘ •> / » 

A comparable! sjample of; nine raters vijewed the same three shows ana 

' i I 1 | ' f 

made high, _lowi, ind intermediatte/unsure predictions about.children•s 


responses v/ithout reference^ to any of the define^ attributes. These raters 


were familiar/with the disfractfor condition and yith the response that 

./ :. j ~ i 

was being.measured. Whilefthey succeeded in differentiating the bits at 


bettor than chance levels ' (x^ * 8.8 with 2 d.f.H they differentiated - 


the nigh irom the low bits significantly .ess accurately than had thosO 
raters who had used the attribute model, x 2 — 8,1 with i d.f., p (.01. 





